Pandas Profiling Report

Dataset statistics

Number of variables	36
Number of observations	887379
Missing cells	3125093
Missing cells (%)	9.8%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	243.7 MiB
Average record size in memory	288.0 B

Variable types

NUM	22
CAT	13
UNSUPPORTED	1

Warnings

`batch_ID` has a high cardinality: 207 distinct values	High cardinality
`State` has a high cardinality: 51 distinct values	High cardinality
`last_week_pay` has a high cardinality: 98 distinct values	High cardinality
`sub_grade` is highly correlated with `grade`	High correlation
`grade` is highly correlated with `sub_grade`	High correlation
`batch_ID` has 130748 (14.7%) missing values	Missing
`Emp_designation` has 51463 (5.8%) missing values	Missing
`Experience` has 44825 (5.1%) missing values	Missing
`mths_since_last_delinq` has 454312 (51.2%) missing values	Missing
`mths_since_last_record` has 750326 (84.6%) missing values	Missing
`mths_since_last_major_derog` has 665676 (75.0%) missing values	Missing
`verification_status_joint` has 886868 (99.9%) missing values	Missing
`tot_colle_amt` has 70276 (7.9%) missing values	Missing
`tot_curr_bal` has 70276 (7.9%) missing values	Missing
`annual_inc` is highly skewed (γ1 = 44.47848687)	Skewed
`debt_income_ratio` is highly skewed (γ1 = 441.4867751)	Skewed
`collection_recovery_fee` is highly skewed (γ1 = 29.65569253)	Skewed
`acc_now_delinq` is highly skewed (γ1 = 24.06635681)	Skewed
`tot_colle_amt` is highly skewed (γ1 = 856.1805436)	Skewed
`member_id` has unique values	Unique
`Emp_designation` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`delinq_2yrs` has 716961 (80.8%) zeros	Zeros
`inq_last_6mths` has 497905 (56.1%) zeros	Zeros
`pub_rec` has 751572 (84.7%) zeros	Zeros
`total_rec_int` has 18214 (2.1%) zeros	Zeros
`total_rec_late_fee` has 874862 (98.6%) zeros	Zeros
`recoveries` has 862702 (97.2%) zeros	Zeros
`collection_recovery_fee` has 863872 (97.4%) zeros	Zeros
`collections_12_mths_ex_med` has 875553 (98.7%) zeros	Zeros
`acc_now_delinq` has 883236 (99.5%) zeros	Zeros
`tot_colle_amt` has 700946 (79.0%) zeros	Zeros

Reproduction

Analysis started	2020-09-23 15:44:03.407221
Analysis finished	2020-09-23 15:50:37.819796
Duration	6 minutes and 34.41 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

member_id
Real number (ℝ_≥0)

UNIQUE

Distinct	887379
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	35001824.82
Minimum	70473
Maximum	73544841
Zeros	0
Zeros (%)	0.0%
Memory size	6.8 MiB

Quantile statistics

Minimum	70473
5-th percentile	1317185.3
Q1	10877133.5
median	37095283
Q3	58471347
95-th percentile	70387497.7
Maximum	73544841
Range	73474368
Interquartile range (IQR)	47594213.5

Descriptive statistics

Standard deviation	24113354.68
Coefficient of variation (CV)	0.6889170723
Kurtosis	-1.465814498
Mean	35001824.82
Median Absolute Deviation (MAD)	23481873
Skewness	0.01741211777
Sum	3.10598843e+13
Variance	5.814538737e+14
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
58732538	1	< 0.1%
9606920	1	< 0.1%
1187609	1	< 0.1%
34762519	1	< 0.1%
70418197	1	< 0.1%
69870319	1	< 0.1%
13786897	1	< 0.1%
11687696	1	< 0.1%
55750415	1	< 0.1%
61047571	1	< 0.1%
Other values (887369)	887369	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
70473	1	< 0.1%
70626	1	< 0.1%
70651	1	< 0.1%
70681	1	< 0.1%
70694	1	< 0.1%

Value	Count	Frequency (%)
73544841	1	< 0.1%
73544827	1	< 0.1%
73542831	1	< 0.1%
73519894	1	< 0.1%
73519870	1	< 0.1%

loan_amnt
Real number (ℝ_≥0)

Distinct	1372
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	14755.26461
Minimum	500
Maximum	35000
Zeros	0
Zeros (%)	0.0%
Memory size	6.8 MiB

Quantile statistics

Minimum	500
5-th percentile	3600
Q1	8000
median	13000
Q3	20000
95-th percentile	32000
Maximum	35000
Range	34500
Interquartile range (IQR)	12000

Descriptive statistics

Standard deviation	8435.455601
Coefficient of variation (CV)	0.5716912456
Kurtosis	-0.2567150485
Mean	14755.26461
Median Absolute Deviation (MAD)	5800
Skewness	0.6816831449
Sum	1.309351195e+10
Variance	71156911.2
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10000	61837	7.0%
12000	50183	5.7%
15000	47210	5.3%
20000	46932	5.3%
35000	36368	4.1%
8000	27870	3.1%
5000	27167	3.1%
6000	26207	3.0%
25000	24125	2.7%
16000	23708	2.7%
Other values (1362)	515772	58.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
500	11	< 0.1%
550	1	< 0.1%
600	6	< 0.1%
700	3	< 0.1%
725	1	< 0.1%

Value	Count	Frequency (%)
35000	36368	4.1%
34975	31	< 0.1%
34950	18	< 0.1%
34925	9	< 0.1%
34900	14	< 0.1%

terms
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	6.8 MiB

36 months	621125
60 months	266254

Frequencies
Length

Value	Count	Frequency (%)
36 months	621125	70.0%
60 months	266254	30.0%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	9
Median length	9
Mean length	9
Min length	9

batch_ID
Categorical

HIGH CARDINALITY
MISSING

Distinct	207
Distinct (%)	< 0.1%
Missing	130748
Missing (%)	14.7%
Memory size	6.8 MiB

	234087
BAT2252229	18791
BAT3873588	17839
BAT2803411	17111
BAT2078974	14859
Other values (202)	453944

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
	234087	26.4%
BAT2252229	18791	2.1%
BAT3873588	17839	2.0%
BAT2803411	17111	1.9%
BAT2078974	14859	1.7%
BAT1586599	14463	1.6%
BAT1780517	13918	1.6%
BAT1104812	13505	1.5%
BAT4694572	13504	1.5%
BAT1184694	12251	1.4%
Other values (197)	386303	43.5%
(Missing)	130748	14.7%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	10
Median length	10
Mean length	6.567822768
Min length	1

Rate_of_intrst
Real number (ℝ_≥0)

Distinct	542
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	13.24673968
Minimum	5.32
Maximum	28.99
Zeros	0
Zeros (%)	0.0%
Memory size	6.8 MiB

Quantile statistics

Minimum	5.32
5-th percentile	6.62
Q1	9.99
median	12.99
Q3	16.2
95-th percentile	20.99
Maximum	28.99
Range	23.67
Interquartile range (IQR)	6.21

Descriptive statistics

Standard deviation	4.381867415
Coefficient of variation (CV)	0.3307883691
Kurtosis	-0.1553615492
Mean	13.24673968
Median Absolute Deviation (MAD)	3
Skewness	0.4294806279
Sum	11754878.61
Variance	19.20076204
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10.99	34624	3.9%
9.17	25720	2.9%
15.61	25201	2.8%
9.99	21553	2.4%
7.89	20311	2.3%
13.99	19076	2.1%
12.69	18783	2.1%
12.29	18603	2.1%
12.99	18540	2.1%
17.57	18001	2.0%
Other values (532)	666967	75.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
5.32	9651	1.1%
5.42	573	0.1%
5.79	410	< 0.1%
5.93	1812	0.2%
5.99	347	< 0.1%

Value	Count	Frequency (%)
28.99	112	< 0.1%
28.49	139	< 0.1%
27.99	5	< 0.1%
27.88	222	< 0.1%
27.49	7	< 0.1%

grade
Categorical

HIGH CORRELATION

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	6.8 MiB

B	254535
C	245860
A	148202
D	139542
E	70705
Other values (2)	28535

Frequencies
Length

Value	Count	Frequency (%)
B	254535	28.7%
C	245860	27.7%
A	148202	16.7%
D	139542	15.7%
E	70705	8.0%
F	23046	2.6%
G	5489	0.6%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

sub_grade
Categorical

HIGH CORRELATION

Distinct	35
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	6.8 MiB

B3	56323
B4	55626
C1	53387
C2	52236
C3	50161
Other values (30)	619646

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
B3	56323	6.3%
B4	55626	6.3%
C1	53387	6.0%
C2	52236	5.9%
C3	50161	5.7%
C4	48857	5.5%
B5	48833	5.5%
B2	48781	5.5%
B1	44972	5.1%
A5	44816	5.1%
Other values (25)	383387	43.2%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	2
Median length	2
Mean length	2
Min length	2

Emp_designation
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	51463
Missing (%)	5.8%
Memory size	6.8 MiB

Experience
Categorical

MISSING

Distinct	11
Distinct (%)	< 0.1%
Missing	44825
Missing (%)	5.1%
Memory size	6.8 MiB

10+ years	291569
2 years	78870
< 1 year	70605
3 years	70026
1 year	57095
Other values (6)	274389

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
10+ years	291569	32.9%
2 years	78870	8.9%
< 1 year	70605	8.0%
3 years	70026	7.9%
1 year	57095	6.4%
5 years	55704	6.3%
4 years	52529	5.9%
7 years	44594	5.0%
8 years	43955	5.0%
6 years	42950	4.8%
(Missing)	44825	5.1%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	9
Median length	7
Mean length	7.470315389
Min length	3

home_ownership
Categorical

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	6.8 MiB

MORTGAGE	443557
RENT	356117
OWN	87470
OTHER	182
NONE	50

Frequencies
Length

Value	Count	Frequency (%)
MORTGAGE	443557	50.0%
RENT	356117	40.1%
OWN	87470	9.9%
OTHER	182	< 0.1%
NONE	50	< 0.1%
ANY	3	< 0.1%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	8
Median length	5
Mean length	5.901033268
Min length	3

annual_inc
Real number (ℝ_≥0)

SKEWED

Distinct	49384
Distinct (%)	5.6%
Missing	4
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	75027.58776
Minimum	0
Maximum	9500000
Zeros	2
Zeros (%)	< 0.1%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	28000
Q1	45000
median	65000
Q3	90000
95-th percentile	150000
Maximum	9500000
Range	9500000
Interquartile range (IQR)	45000

Descriptive statistics

Standard deviation	64698.30014
Coefficient of variation (CV)	0.8623268064
Kurtosis	4808.192204
Mean	75027.58776
Median Absolute Deviation (MAD)	20800
Skewness	44.47848687
Sum	6.657760569e+10
Variance	4185870041
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
60000	34281	3.9%
50000	30575	3.4%
65000	25498	2.9%
70000	24121	2.7%
40000	23943	2.7%
80000	22729	2.6%
45000	22699	2.6%
75000	22435	2.5%
55000	20755	2.3%
90000	17159	1.9%
Other values (49374)	643180	72.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2	< 0.1%
1200	1	< 0.1%
1770	1	< 0.1%
1896	1	< 0.1%
2000	1	< 0.1%

Value	Count	Frequency (%)
9500000	1	< 0.1%
9000000	1	< 0.1%
8900060	1	< 0.1%
8706582	1	< 0.1%
8700000	1	< 0.1%

verification_status
Categorical

Distinct	3
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	6.8 MiB

Source Verified	329558
Verified	291071
Not Verified	266750

Frequencies
Length

Value	Count	Frequency (%)
Source Verified	329558	37.1%
Verified	291071	32.8%
Not Verified	266750	30.1%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	15
Median length	12
Mean length	11.8021026
Min length	8

purpose
Categorical

Distinct	14
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	6.8 MiB

debt_consolidation	524215
credit_card	206182
home_improvement	51829
other	42894
major_purchase	17277
Other values (9)	44982

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
debt_consolidation	524215	59.1%
credit_card	206182	23.2%
home_improvement	51829	5.8%
other	42894	4.8%
major_purchase	17277	1.9%
small_business	10377	1.2%
car	8863	1.0%
medical	8540	1.0%
moving	5414	0.6%
vacation	4736	0.5%
Other values (4)	7052	0.8%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	18
Median length	18
Mean length	15.0333961
Min length	3

State
Categorical

HIGH CARDINALITY

Distinct	51
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	6.8 MiB

CA	129517
NY	74086
TX	71138
FL	60935
IL	35476
Other values (46)	516227

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
CA	129517	14.6%
NY	74086	8.3%
TX	71138	8.0%
FL	60935	6.9%
IL	35476	4.0%
NJ	33256	3.7%
PA	31393	3.5%
OH	29631	3.3%
GA	29085	3.3%
VA	26255	3.0%
Other values (41)	366607	41.3%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	2
Median length	2
Mean length	2
Min length	2

debt_income_ratio
Real number (ℝ_≥0)

SKEWED

Distinct	4086
Distinct (%)	0.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	18.15703874
Minimum	0
Maximum	9999
Zeros	451
Zeros (%)	0.1%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	5.2
Q1	11.91
median	17.65
Q3	23.95
95-th percentile	32.72
Maximum	9999
Range	9999
Interquartile range (IQR)	12.04

Descriptive statistics

Standard deviation	17.19062569
Coefficient of variation (CV)	0.9467747431
Kurtosis	256126.8629
Mean	18.15703874
Median Absolute Deviation (MAD)	6
Skewness	441.4867751
Sum	16112174.88
Variance	295.5176115
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
19.2	684	0.1%
14.4	674	0.1%
18	661	0.1%
13.2	638	0.1%
16.8	632	0.1%
15.6	626	0.1%
20.4	598	0.1%
12	596	0.1%
21.6	594	0.1%
24	534	0.1%
Other values (4076)	881142	99.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	451	0.1%
0.01	10	< 0.1%
0.02	12	< 0.1%
0.03	8	< 0.1%
0.04	6	< 0.1%

Value	Count	Frequency (%)
9999	2	< 0.1%
1092.52	1	< 0.1%
672.52	1	< 0.1%
380.53	1	< 0.1%
137.4	1	< 0.1%

delinq_2yrs
Real number (ℝ_≥0)

ZEROS

Distinct	29
Distinct (%)	< 0.1%
Missing	29
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	0.3144418775
Minimum	0
Maximum	39
Zeros	716961
Zeros (%)	80.8%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	2
Maximum	39
Range	39
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.8622438402
Coefficient of variation (CV)	2.742140605
Kurtosis	57.30908145
Mean	0.3144418775
Median Absolute Deviation (MAD)	0
Skewness	5.473795937
Sum	279020
Variance	0.74346444
Monotocity	Not monotonic

Histogram with fixed size bins (bins=29)

Value	Count	Frequency (%)
0	716961	80.8%
1	113224	12.8%
2	33551	3.8%
3	11977	1.3%
4	5327	0.6%
5	2711	0.3%
6	1471	0.2%
7	784	0.1%
8	461	0.1%
9	284	< 0.1%
Other values (19)	599	0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	716961	80.8%
1	113224	12.8%
2	33551	3.8%
3	11977	1.3%
4	5327	0.6%

Value	Count	Frequency (%)
39	1	< 0.1%
30	1	< 0.1%
29	1	< 0.1%
27	1	< 0.1%
26	2	< 0.1%

inq_last_6mths
Real number (ℝ_≥0)

ZEROS

Distinct	28
Distinct (%)	< 0.1%
Missing	29
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	0.6946233166
Minimum	0
Maximum	33
Zeros	497905
Zeros (%)	56.1%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	3
Maximum	33
Range	33
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.998447685
Coefficient of variation (CV)	1.437394428
Kurtosis	11.92510347
Mean	0.6946233166
Median Absolute Deviation (MAD)	0
Skewness	2.108410998
Sum	616374
Variance	0.9968977796
Monotocity	Not monotonic

Histogram with fixed size bins (bins=28)

Value	Count	Frequency (%)
0	497905	56.1%
1	241494	27.2%
2	94117	10.6%
3	37398	4.2%
4	10758	1.2%
5	3985	0.4%
6	1231	0.1%
7	195	< 0.1%
8	122	< 0.1%
9	50	< 0.1%
Other values (18)	95	< 0.1%
(Missing)	29	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	497905	56.1%
1	241494	27.2%
2	94117	10.6%
3	37398	4.2%
4	10758	1.2%

Value	Count	Frequency (%)
33	1	< 0.1%
32	1	< 0.1%
31	1	< 0.1%
28	1	< 0.1%
27	1	< 0.1%

mths_since_last_delinq
Real number (ℝ_≥0)

MISSING

Distinct	155
Distinct (%)	< 0.1%
Missing	454312
Missing (%)	51.2%
Infinite	0
Infinite (%)	0.0%

Mean	34.06379844
Minimum	0
Maximum	188
Zeros	1723
Zeros (%)	0.2%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	5
Q1	15
median	31
Q3	50
95-th percentile	74
Maximum	188
Range	188
Interquartile range (IQR)	35

Descriptive statistics

Standard deviation	21.88494023
Coefficient of variation (CV)	0.6424691675
Kurtosis	-0.767314425
Mean	34.06379844
Median Absolute Deviation (MAD)	17
Skewness	0.4555195831
Sum	14751907
Variance	478.9506087
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
9	8591	1.0%
6	8470	1.0%
12	8368	0.9%
8	8335	0.9%
13	8318	0.9%
7	8274	0.9%
10	8215	0.9%
14	8063	0.9%
15	8007	0.9%
11	7845	0.9%
Other values (145)	350581	39.5%
(Missing)	454312	51.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1723	0.2%
1	3287	0.4%
2	3938	0.4%
3	4938	0.6%
4	5959	0.7%

Value	Count	Frequency (%)
188	1	< 0.1%
180	1	< 0.1%
176	1	< 0.1%
171	1	< 0.1%
170	3	< 0.1%

mths_since_last_record
Real number (ℝ_≥0)

MISSING

Distinct	123
Distinct (%)	0.1%
Missing	750326
Missing (%)	84.6%
Infinite	0
Infinite (%)	0.0%

Mean	70.11790329
Minimum	0
Maximum	129
Zeros	1283
Zeros (%)	0.1%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	21
Q1	51
median	70
Q3	92
95-th percentile	115
Maximum	129
Range	129
Interquartile range (IQR)	41

Descriptive statistics

Standard deviation	28.12791357
Coefficient of variation (CV)	0.4011516638
Kurtosis	-0.5852228553
Mean	70.11790329
Median Absolute Deviation (MAD)	20
Skewness	-0.1985676223
Sum	9609869
Variance	791.1795216
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
61	1964	0.2%
62	1919	0.2%
67	1917	0.2%
71	1917	0.2%
69	1914	0.2%
64	1909	0.2%
65	1896	0.2%
66	1895	0.2%
63	1890	0.2%
70	1884	0.2%
Other values (113)	117948	13.3%
(Missing)	750326	84.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1283	0.1%
1	71	< 0.1%
2	63	< 0.1%
3	114	< 0.1%
4	141	< 0.1%

Value	Count	Frequency (%)
129	1	< 0.1%
121	2	< 0.1%
120	9	< 0.1%
119	925	0.1%
118	1495	0.2%

numb_credit
Real number (ℝ_≥0)

Distinct	77
Distinct (%)	< 0.1%
Missing	29
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	11.54846904
Minimum	0
Maximum	90
Zeros	7
Zeros (%)	< 0.1%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	5
Q1	8
median	11
Q3	14
95-th percentile	21
Maximum	90
Range	90
Interquartile range (IQR)	6

Descriptive statistics

Standard deviation	5.317313125
Coefficient of variation (CV)	0.4604344617
Kurtosis	3.103994403
Mean	11.54846904
Median Absolute Deviation (MAD)	3
Skewness	1.249380264
Sum	10247534
Variance	28.27381886
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
9	80285	9.0%
10	78321	8.8%
8	76578	8.6%
11	72265	8.1%
7	67896	7.7%
12	64690	7.3%
13	56642	6.4%
6	55954	6.3%
14	47814	5.4%
15	39778	4.5%
Other values (67)	247127	27.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	7	< 0.1%
1	232	< 0.1%
2	2776	0.3%
3	9619	1.1%
4	23367	2.6%

Value	Count	Frequency (%)
90	1	< 0.1%
84	1	< 0.1%
82	1	< 0.1%
79	1	< 0.1%
76	2	< 0.1%

pub_rec
Real number (ℝ_≥0)

ZEROS

Distinct	32
Distinct (%)	< 0.1%
Missing	29
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	0.1953073759
Minimum	0
Maximum	86
Zeros	751572
Zeros (%)	84.7%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	1
Maximum	86
Range	86
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.5820906693
Coefficient of variation (CV)	2.980382418
Kurtosis	993.1990083
Mean	0.1953073759
Median Absolute Deviation (MAD)	0
Skewness	13.26194117
Sum	173306
Variance	0.3388295472
Monotocity	Not monotonic

Histogram with fixed size bins (bins=32)

Value	Count	Frequency (%)
0	751572	84.7%
1	113266	12.8%
2	14854	1.7%
3	4487	0.5%
4	1564	0.2%
5	757	0.1%
6	385	< 0.1%
7	170	< 0.1%
8	113	< 0.1%
9	50	< 0.1%
Other values (22)	132	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	751572	84.7%
1	113266	12.8%
2	14854	1.7%
3	4487	0.5%
4	1564	0.2%

Value	Count	Frequency (%)
86	1	< 0.1%
63	1	< 0.1%
54	1	< 0.1%
49	2	< 0.1%
40	1	< 0.1%

total revol_bal
Real number (ℝ_≥0)

Distinct	73740
Distinct (%)	8.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	16920.78753
Minimum	0
Maximum	2904836
Zeros	3402
Zeros (%)	0.4%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	2031
Q1	6443
median	11875
Q3	20829
95-th percentile	43897
Maximum	2904836
Range	2904836
Interquartile range (IQR)	14386

Descriptive statistics

Standard deviation	22426.7919
Coefficient of variation (CV)	1.325398824
Kurtosis	985.8907789
Mean	16920.78753
Median Absolute Deviation (MAD)	6444
Skewness	15.94930161
Sum	1.501515152e+10
Variance	502960994.7
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	3402	0.4%
5235	74	< 0.1%
5466	72	< 0.1%
4479	68	< 0.1%
6969	67	< 0.1%
6223	67	< 0.1%
8696	67	< 0.1%
5849	66	< 0.1%
5853	66	< 0.1%
8073	66	< 0.1%
Other values (73730)	883364	99.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	3402	0.4%
1	43	< 0.1%
2	45	< 0.1%
3	47	< 0.1%
4	38	< 0.1%

Value	Count	Frequency (%)
2904836	1	< 0.1%
2568995	1	< 0.1%
2560703	1	< 0.1%
1746716	1	< 0.1%
1743266	1	< 0.1%

total_credits
Real number (ℝ_≥0)

Distinct	135
Distinct (%)	< 0.1%
Missing	29
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	25.26802615
Minimum	1
Maximum	169
Zeros	0
Zeros (%)	0.0%
Memory size	6.8 MiB

Quantile statistics

Minimum	1
5-th percentile	9
Q1	17
median	24
Q3	32
95-th percentile	47
Maximum	169
Range	168
Interquartile range (IQR)	15

Descriptive statistics

Standard deviation	11.84056106
Coefficient of variation (CV)	0.4685985757
Kurtosis	1.377589349
Mean	25.26802615
Median Absolute Deviation (MAD)	8
Skewness	0.8925390335
Sum	22421583
Variance	140.1988863
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
22	32259	3.6%
20	32118	3.6%
21	32009	3.6%
19	31574	3.6%
23	31315	3.5%
18	31108	3.5%
24	31039	3.5%
17	30768	3.5%
25	29721	3.3%
16	29126	3.3%
Other values (125)	576313	64.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	21	< 0.1%
2	62	< 0.1%
3	472	0.1%
4	2873	0.3%
5	4645	0.5%

Value	Count	Frequency (%)
169	1	< 0.1%
162	1	< 0.1%
156	1	< 0.1%
151	1	< 0.1%
150	1	< 0.1%

initial_list_status
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	6.8 MiB

f	456848
w	430531

Frequencies
Length

Value	Count	Frequency (%)
f	456848	51.5%
w	430531	48.5%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

total_rec_int
Real number (ℝ_≥0)

ZEROS

Distinct	324635
Distinct (%)	36.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1754.804327
Minimum	0
Maximum	24205.62
Zeros	18214
Zeros (%)	2.1%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	80.08
Q1	441.46
median	1073.28
Q3	2238.265
95-th percentile	5891.48
Maximum	24205.62
Range	24205.62
Interquartile range (IQR)	1796.805

Descriptive statistics

Standard deviation	2095.356099
Coefficient of variation (CV)	1.194068232
Kurtosis	11.5435983
Mean	1754.804327
Median Absolute Deviation (MAD)	758.87
Skewness	2.826099789
Sum	1557176509
Variance	4390517.183
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	18214	2.1%
82.76	138	< 0.1%
174.9	125	< 0.1%
71.33	124	< 0.1%
283.29	119	< 0.1%
41.37	113	< 0.1%
130.12	112	< 0.1%
194.92	108	< 0.1%
451.32	108	< 0.1%
258.02	108	< 0.1%
Other values (324625)	868110	97.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	18214	2.1%
0.01	11	< 0.1%
0.39	1	< 0.1%
0.56	1	< 0.1%
0.59	1	< 0.1%

Value	Count	Frequency (%)
24205.62	1	< 0.1%
23450.38	1	< 0.1%
23172.31	1	< 0.1%
23171.65	1	< 0.1%
23062.45	1	< 0.1%

total_rec_late_fee
Real number (ℝ_≥0)

ZEROS

Distinct	6106
Distinct (%)	0.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.3966917913
Minimum	0
Maximum	358.68
Zeros	874862
Zeros (%)	98.6%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	358.68
Range	358.68
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	4.08782534
Coefficient of variation (CV)	10.30478933
Kurtosis	515.7241654
Mean	0.3966917913
Median Absolute Deviation (MAD)	0
Skewness	17.4040854
Sum	352015.9651
Variance	16.71031601
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	874862	98.6%
15	2845	0.3%
30	339	< 0.1%
45	58	< 0.1%
60	18	< 0.1%
17.48	16	< 0.1%
16.37	16	< 0.1%
16.84	16	< 0.1%
18.87	15	< 0.1%
16.06	14	< 0.1%
Other values (6096)	9180	1.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	874862	98.6%
0.01	6	< 0.1%
0.060799751	1	< 0.1%
0.073787104	1	< 0.1%
0.081837685	1	< 0.1%

Value	Count	Frequency (%)
358.68	1	< 0.1%
294.68	1	< 0.1%
286.7475657	1	< 0.1%
268.55	1	< 0.1%
252.8	1	< 0.1%

recoveries
Real number (ℝ_≥0)

ZEROS

Distinct	23055
Distinct (%)	2.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	45.91924337
Minimum	0
Maximum	33520.27
Zeros	862702
Zeros (%)	97.2%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	33520.27
Range	33520.27
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	409.6938736
Coefficient of variation (CV)	8.922051923
Kurtosis	617.2114172
Mean	45.91924337
Median Absolute Deviation (MAD)	0
Skewness	18.06183892
Sum	40747772.26
Variance	167849.0701
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	862702	97.2%
200	10	< 0.1%
14.28	9	< 0.1%
11.7	9	< 0.1%
10	9	< 0.1%
100	8	< 0.1%
16.5	8	< 0.1%
800	8	< 0.1%
10.4	8	< 0.1%
16.8	8	< 0.1%
Other values (23045)	24600	2.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	862702	97.2%
0.25	1	< 0.1%
2.34	1	< 0.1%
3.6	1	< 0.1%
4.4	1	< 0.1%

Value	Count	Frequency (%)
33520.27	1	< 0.1%
31900.52	1	< 0.1%
29623.35	1	< 0.1%
29282.07	1	< 0.1%
27750	1	< 0.1%

collection_recovery_fee
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct	20549
Distinct (%)	2.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4.88075738
Minimum	0
Maximum	7002.19
Zeros	863872
Zeros (%)	97.4%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	7002.19
Range	7002.19
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	63.12528092
Coefficient of variation (CV)	12.93350109
Kurtosis	1684.165359
Mean	4.88075738
Median Absolute Deviation (MAD)	0
Skewness	29.65569253
Sum	4331081.603
Variance	3984.801091
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	863872	97.4%
2	18	< 0.1%
1.8	13	< 0.1%
1.2	12	< 0.1%
1.88	12	< 0.1%
1.55	12	< 0.1%
4.52	11	< 0.1%
0.8	11	< 0.1%
3.93	11	< 0.1%
1.6	11	< 0.1%
Other values (20539)	23396	2.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	863872	97.4%
0.036	1	< 0.1%
0.045	1	< 0.1%
0.063	1	< 0.1%
0.071099997	1	< 0.1%

Value	Count	Frequency (%)
7002.19	1	< 0.1%
6972.59	1	< 0.1%
6543.04	1	< 0.1%
5774.8	1	< 0.1%
5694.0936	1	< 0.1%

collections_12_mths_ex_med
Real number (ℝ_≥0)

ZEROS

Distinct	12
Distinct (%)	< 0.1%
Missing	145
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	0.01437952107
Minimum	0
Maximum	20
Zeros	875553
Zeros (%)	98.7%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	20
Range	20
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.1341907576
Coefficient of variation (CV)	9.332074196
Kurtosis	1097.854795
Mean	0.01437952107
Median Absolute Deviation (MAD)	0
Skewness	17.4104002
Sum	12758
Variance	0.01800715942
Monotocity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
0	875553	98.7%
1	10824	1.2%
2	732	0.1%
3	88	< 0.1%
4	23	< 0.1%
5	7	< 0.1%
6	2	< 0.1%
7	1	< 0.1%
20	1	< 0.1%
16	1	< 0.1%
Other values (2)	2	< 0.1%
(Missing)	145	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	875553	98.7%
1	10824	1.2%
2	732	0.1%
3	88	< 0.1%
4	23	< 0.1%

Value	Count	Frequency (%)
20	1	< 0.1%
16	1	< 0.1%
14	1	< 0.1%
10	1	< 0.1%
7	1	< 0.1%

mths_since_last_major_derog
Real number (ℝ_≥0)

MISSING

Distinct	168
Distinct (%)	0.1%
Missing	665676
Missing (%)	75.0%
Infinite	0
Infinite (%)	0.0%

Mean	44.10483846
Minimum	0
Maximum	188
Zeros	153
Zeros (%)	< 0.1%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	9
Q1	27
median	44
Q3	61
95-th percentile	77
Maximum	188
Range	188
Interquartile range (IQR)	34

Descriptive statistics

Standard deviation	22.17984069
Coefficient of variation (CV)	0.5028890586
Kurtosis	-0.03136195505
Mean	44.10483846
Median Absolute Deviation (MAD)	17
Skewness	0.2649316915
Sum	9778175
Variance	491.9453331
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
45	3471	0.4%
42	3444	0.4%
46	3420	0.4%
48	3405	0.4%
43	3374	0.4%
38	3357	0.4%
44	3356	0.4%
40	3348	0.4%
37	3277	0.4%
41	3277	0.4%
Other values (158)	187974	21.2%
(Missing)	665676	75.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	153	< 0.1%
1	591	0.1%
2	599	0.1%
3	691	0.1%
4	1000	0.1%

Value	Count	Frequency (%)
188	1	< 0.1%
180	1	< 0.1%
176	1	< 0.1%
171	1	< 0.1%
170	3	< 0.1%

application_type
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	6.8 MiB

INDIVIDUAL	886868
JOINT	511

Frequencies
Length

Value	Count	Frequency (%)
INDIVIDUAL	886868	99.9%
JOINT	511	0.1%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	10
Median length	10
Mean length	9.997120734
Min length	5

verification_status_joint
Categorical

MISSING

Distinct	3
Distinct (%)	0.6%
Missing	886868
Missing (%)	99.9%
Memory size	6.8 MiB

Not Verified	283
Verified	167
Source Verified	61

Frequencies
Length

Value	Count	Frequency (%)
Not Verified	283	< 0.1%
Verified	167	< 0.1%
Source Verified	61	< 0.1%
(Missing)	886868	99.9%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	15
Median length	3
Mean length	3.004636125
Min length	3

last_week_pay
Categorical

HIGH CARDINALITY

Distinct	98
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	6.8 MiB

13th week	50321
9th week	47680
26th week	45989
22th week	43342
4th week	43105
Other values (93)	656942

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
13th week	50321	5.7%
9th week	47680	5.4%
26th week	45989	5.2%
22th week	43342	4.9%
4th week	43105	4.9%
35th week	40162	4.5%
39th week	39767	4.5%
17th week	36684	4.1%
31th week	35386	4.0%
48th week	32189	3.6%
Other values (88)	472754	53.3%

Frequencies of value counts

Unique

Unique	5 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	10
Median length	9
Mean length	9.075471698
Min length	8

acc_now_delinq
Real number (ℝ_≥0)

SKEWED
ZEROS

Distinct	8
Distinct (%)	< 0.1%
Missing	29
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%

Mean	0.004991266129
Minimum	0
Maximum	14
Zeros	883236
Zeros (%)	99.5%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	14
Range	14
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.07762534479
Coefficient of variation (CV)	15.5522352
Kurtosis	1630.866453
Mean	0.004991266129
Median Absolute Deviation (MAD)	0
Skewness	24.06635681
Sum	4429
Variance	0.006025694155
Monotocity	Not monotonic

Histogram with fixed size bins (bins=8)

Value	Count	Frequency (%)
0	883236	99.5%
1	3866	0.4%
2	208	< 0.1%
3	28	< 0.1%
4	7	< 0.1%
5	3	< 0.1%
6	1	< 0.1%
14	1	< 0.1%
(Missing)	29	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	883236	99.5%
1	3866	0.4%
2	208	< 0.1%
3	28	< 0.1%
4	7	< 0.1%

Value	Count	Frequency (%)
14	1	< 0.1%
6	1	< 0.1%
5	3	< 0.1%
4	7	< 0.1%
3	28	< 0.1%

tot_colle_amt
Real number (ℝ_≥0)

MISSING
SKEWED
ZEROS

Distinct	10325
Distinct (%)	1.3%
Missing	70276
Missing (%)	7.9%
Infinite	0
Infinite (%)	0.0%

Mean	225.7026103
Minimum	0
Maximum	9152545
Zeros	700946
Zeros (%)	79.0%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	635
Maximum	9152545
Range	9152545
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	10311.3672
Coefficient of variation (CV)	45.68563554
Kurtosis	759611.2129
Mean	225.7026103
Median Absolute Deviation (MAD)	0
Skewness	856.1805436
Sum	184422280
Variance	106324293.4
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	700946	79.0%
50	1755	0.2%
100	1357	0.2%
75	1044	0.1%
200	714	0.1%
150	702	0.1%
60	693	0.1%
70	616	0.1%
80	596	0.1%
55	536	0.1%
Other values (10315)	108144	12.2%
(Missing)	70276	7.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	700946	79.0%
2	3	< 0.1%
3	2	< 0.1%
4	1	< 0.1%
5	1	< 0.1%

Value	Count	Frequency (%)
9152545	1	< 0.1%
496651	1	< 0.1%
380757	1	< 0.1%
296368	1	< 0.1%
262740	1	< 0.1%

tot_curr_bal
Real number (ℝ_≥0)

MISSING

Distinct	327342
Distinct (%)	40.1%
Missing	70276
Missing (%)	7.9%
Infinite	0
Infinite (%)	0.0%

Mean	139458.1893
Minimum	0
Maximum	8000078
Zeros	126
Zeros (%)	< 0.1%
Memory size	6.8 MiB

Quantile statistics

Minimum	0
5-th percentile	9173
Q1	29853
median	80559
Q3	208205
95-th percentile	424658.4
Maximum	8000078
Range	8000078
Interquartile range (IQR)	178352

Descriptive statistics

Standard deviation	153749.9669
Coefficient of variation (CV)	1.102480734
Kurtosis	29.40881116
Mean	139458.1893
Median Absolute Deviation (MAD)	63211
Skewness	2.918174325
Sum	1.139517049e+11
Variance	2.363905232e+10
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	126	< 0.1%
34574	21	< 0.1%
22396	21	< 0.1%
29232	21	< 0.1%
27316	21	< 0.1%
19998	20	< 0.1%
14511	20	< 0.1%
23269	19	< 0.1%
5537	19	< 0.1%
26937	19	< 0.1%
Other values (327332)	816796	92.0%
(Missing)	70276	7.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	126	< 0.1%
1	1	< 0.1%
2	5	< 0.1%
3	2	< 0.1%
4	3	< 0.1%

Value	Count	Frequency (%)
8000078	1	< 0.1%
4772549	1	< 0.1%
4447397	1	< 0.1%
4127799	1	< 0.1%
4026405	1	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	member_id	loan_amnt	terms	batch_ID	Rate_of_intrst	grade	sub_grade	Emp_designation	Experience	home_ownership	annual_inc	verification_status	purpose	State	debt_income_ratio	inq_last_6mths	mths_since_last_delinq	mths_since_last_record	numb_credit	pub_rec	total revol_bal	total_credits	initial_list_status	total_rec_int	mths_since_last_major_derog	application_type	verification_status_joint	last_week_pay	tot_colle_amt	tot_curr_bal
0	58189336	14350	36 months		19.19	E	E3	clerk	9 years	OWN	28700.0	Source Verified	debt_consolidation	FL	33.88	1.0	50.0	75.0	14.0	1.0	22515	28.0	f	1173.84	74.0	INDIVIDUAL	NaN	26th week	0.0	28699.0
1	70011223	4800	36 months	BAT1586599	10.99	B	B4	Human Resources Specialist	< 1 year	MORTGAGE	65000.0	Source Verified	home_improvement	MD	3.64	1.0	NaN	NaN	6.0	0.0	7624	13.0	w	83.95	NaN	INDIVIDUAL	NaN	9th week	0.0	9974.0
2	70255675	10000	36 months	BAT1586599	7.26	A	A4	Driver	2 years	OWN	45000.0	Not Verified	debt_consolidation	OH	18.42	0.0	NaN	NaN	5.0	0.0	10877	19.0	w	56.47	NaN	INDIVIDUAL	NaN	9th week	65.0	38295.0
3	1893936	15000	36 months	BAT4808022	19.72	D	D5	Us office of Personnel Management	10+ years	RENT	105000.0	Not Verified	debt_consolidation	VA	14.97	2.0	46.0	NaN	10.0	0.0	13712	21.0	f	4858.62	NaN	INDIVIDUAL	NaN	135th week	0.0	55564.0
4	7652106	16000	36 months	BAT2833642	10.64	B	B2	LAUSD-HOLLYWOOD HIGH SCHOOL	10+ years	RENT	52000.0	Verified	credit_card	CA	20.16	0.0	NaN	NaN	11.0	0.0	35835	27.0	w	2296.41	NaN	INDIVIDUAL	NaN	96th week	0.0	47159.0
5	10247268	15000	36 months	BAT2575549	8.90	A	A5	Design Consultant	2 years	MORTGAGE	120000.0	Not Verified	debt_consolidation	IN	12.30	0.0	56.0	NaN	18.0	0.0	19040	30.0	f	1957.24	NaN	INDIVIDUAL	NaN	113th week	0.0	350619.0
6	8089625	5000	36 months		7.90	A	A4	TOYOTA OF NORTH HOLLYWOOD	5 years	RENT	75000.0	Source Verified	debt_consolidation	CA	5.70	0.0	NaN	105.0	13.0	2.0	13272	23.0	f	578.36	NaN	INDIVIDUAL	NaN	117th week	1023.0	13272.0
7	23043116	6000	36 months	NaN	9.17	B	B1	Banker	8 years	MORTGAGE	54000.0	Not Verified	credit_card	AL	11.63	1.0	46.0	NaN	13.0	0.0	3484	49.0	f	637.51	54.0	INDIVIDUAL	NaN	78th week	0.0	272579.0
8	45900933	6000	36 months	BAT4136152	13.99	C	C4	LVN	7 years	MORTGAGE	92000.0	Not Verified	home_improvement	CA	30.85	0.0	77.0	NaN	16.0	0.0	47567	27.0	w	621.72	NaN	INDIVIDUAL	NaN	44th week	0.0	281521.0
9	41272507	34550	60 months	BAT4694572	17.14	D	D4	Registered Nurse	2 years	MORTGAGE	72000.0	Verified	debt_consolidation	KY	33.92	0.0	NaN	NaN	12.0	0.0	30040	30.0	w	5535.46	NaN	INDIVIDUAL	NaN	52th week	0.0	76034.0

Last rows

	member_id	loan_amnt	terms	batch_ID	Rate_of_intrst	grade	sub_grade	Emp_designation	Experience	home_ownership	annual_inc	verification_status	purpose	State	debt_income_ratio	delinq_2yrs	inq_last_6mths	mths_since_last_delinq	mths_since_last_record	numb_credit	pub_rec	total revol_bal	total_credits	initial_list_status	total_rec_int	mths_since_last_major_derog	application_type	verification_status_joint	last_week_pay	tot_colle_amt	tot_curr_bal
887369	55437336	30000	36 months		6.89	A	A3	Director	2 years	RENT	141000.0	Verified	credit_card	NY	4.88	0.0	0.0	NaN	NaN	5.0	0.0	31034	18.0	w	1091.17	NaN	INDIVIDUAL	NaN	31th week	0.0	137358.0
887370	25856020	10000	36 months	BAT446479	10.15	B	B2	Senior Event Services Manager	9 years	MORTGAGE	40000.0	Not Verified	credit_card	FL	6.63	0.0	1.0	37.0	NaN	7.0	0.0	6300	17.0	f	1151.25	33.0	INDIVIDUAL	NaN	74th week	0.0	97785.0
887371	10386922	22250	36 months	BAT3563724	7.90	A	A4	Engineer	5 years	MORTGAGE	86000.0	Verified	credit_card	LA	28.50	0.0	2.0	NaN	NaN	14.0	0.0	26897	44.0	f	2567.72	NaN	INDIVIDUAL	NaN	113th week	0.0	331709.0
887372	70721678	10800	60 months		20.99	E	E5	Ccr	10+ years	RENT	41000.0	Verified	debt_consolidation	OH	32.70	0.0	3.0	NaN	30.0	17.0	1.0	3569	49.0	w	163.72	NaN	INDIVIDUAL	NaN	4th week	0.0	56129.0
887373	70348484	14300	36 months		15.41	D	D1	Supervisor	10+ years	RENT	52000.0	Verified	other	NY	19.30	1.0	0.0	5.0	NaN	15.0	0.0	9687	33.0	w	159.16	NaN	INDIVIDUAL	NaN	4th week	0.0	88713.0
887374	19145105	15000	36 months	BAT4217242	6.49	A	A2	Network administrator	1 year	MORTGAGE	97250.0	Not Verified	credit_card	TX	12.46	0.0	0.0	77.0	NaN	12.0	0.0	12201	24.0	w	1180.32	77.0	INDIVIDUAL	NaN	83th week	0.0	143920.0
887375	46304777	35000	60 months		25.89	G	G3	Credit Risk Analyst	1 year	OWN	180000.0	Verified	debt_consolidation	NY	11.78	2.0	2.0	19.0	NaN	21.0	0.0	52584	33.0	f	6508.41	NaN	INDIVIDUAL	NaN	39th week	0.0	772713.0
887376	903745	14000	60 months	BAT6117184	17.51	E	E4	USPS/Nashua L&DC	10+ years	OWN	56000.0	Verified	home_improvement	NH	16.44	0.0	3.0	54.0	103.0	11.0	1.0	10948	25.0	f	3456.24	NaN	INDIVIDUAL	NaN	87th week	NaN	NaN
887377	53032475	20000	36 months	BAT3840785	7.26	A	A4	Computer Engineer	< 1 year	MORTGAGE	100000.0	Source Verified	credit_card	MD	15.00	0.0	0.0	NaN	NaN	7.0	0.0	33599	11.0	w	766.84	NaN	INDIVIDUAL	NaN	35th week	0.0	291998.0
887378	994245	2700	60 months	NaN	7.49	A	A4	Jimmy John's Sandwiches	2 years	OWN	12000.0	Not Verified	debt_consolidation	FL	28.00	0.0	0.0	NaN	NaN	7.0	0.0	5118	7.0	f	326.06	NaN	INDIVIDUAL	NaN	104th week	NaN	NaN

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows